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In a study that examined the conditions that were 
likely to facilitate error detection, it was hypothesized that poor 
readers' coaprehension aonitorinq abilities would iaprove if they 
were giten assistance in selecting the appropriate schema for 
understanding a passage, when the hypothesis was tested with 20 sixth 
grade students in an error detection task, however, no evidence was 
found to support the notion that schema activation would 
significantly improve poor readers' error detection abilities. The 
results did indicate that while crood readers were significantly 
better at error detection than were poor readers, a surprising number 
of children failed to report some very blatant errors. Although these 
results are in agreement with earlier studies using the same tdsk, it 
seems questionable to conclude that sixth graders are lacking in 
aetacognitive abilities, »n analysis of the results indicates five 
aajor difficulties in usinq the error detection paradigm: determining 
why subjects do not overtly respond to the presence of errors in the 
text; deter lining which criteria for comprehension subjects have 
chosen to apply; adequately specifying the kind, magnitude, and 
placement of target errors; overrelylnq on probes as dependent 
aeasures: and overrelyinq on subiects • verbal reports about their own 
cognitive processes. (RL) 
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* 

Abstract 

The purpose of this situdy was to examine the conditions which were likely to 
facilitate error detection. It was hypothesized that poor readers' 
comprehension monitoring abilities would improve if they were given assistance 
in selecting the appropriate schema for understanding a passage. In order to 
test the hypothesis, we used a standard paradigm: the error detection task. 
No evidence was found to support the notion that schema activation would 
significantly improve poor readers' error detection abilities. 

However, results did indicate that, while good readers were significantly 
better at this task than were poor readers, a surprising nimber of children 
failed to report soue very blatant errors. Although these results are in 
agreement with earlier studies using the same task, we felt uneasy in drawing 
the conclusion that sixth graders are lacking in metacognitive abilities. 

Instead we have expanded the discussion to include our .houghts on the 
limitations and difficulties in the use of the error detection paradigm 
itself. Five major concerns were identified and suggestions for improving 
future comprehension monitoring studies were made. Some alternative 
methodologies were also considered. 
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Comprebenslon Monitoring and the Error Detection Paradigm 

There Is a great deal of current Interest In metacognltlon* Thl© 
Interest Is. based on the reall«atlon that a valuable distinction can be made 
between knowledge (cognition) and the awareness and control of that knowledge 
(metacognltlon). Vygotsky (1962), for example, described two phases In the 
development of knowledge: first, the automatic, unconscious acquisition of 
knowledge; and second, the gradual Increase In the active control over that 
knowledge. Brown (1978) defended the Isolation of metacognltlve skills for 
study on the grounds that such skills are the essence of Intelligent activity. 
Research Is underway In many subareas of metacognltlon. Reviews of the 
relevant literature can be found for: (a) metacognltlon and memory (Brown, 
. 1978J Flavell & Mellman, 1977); (b) metacognltlon and linguistics (Clark, 
1978); (c) metacognltlon and reading (Anderson, in press; Brown, In press; 
Markman, Note 1); (d) metacognltlon and communication (Shatz, 1978); (e) the 
social origins of metacognltlon (Wertsch, Note 2). 

This paper Is concerned with metacognlton and reading. More 
specifically, it Is concerned with comprehension monitoring and one of the 
research paradigms currently In vogue, error detection. It Is our contention, 
gained through hindsight, that there are some serious problems which may limit 
the usefulness of any data that are collected by this method. The first part 
of this paper will review the original thoughts that led to our attempt to use 
the error detection paradigm. Then the study Itself will be described. The 
last section will cover the Issues and difficulties thac forced us to 
reconsider methodologies. 
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Metacognitlon and Readi ng 
Metacognltlon has been defined as "knowledge that takes as Its object or 
regulates any aspect of any cognitive endeavor" (Flavell, Note 3). Some 
researchers interested in the relationship between metacognitlon and reading 
have focused on what readers know about the task of reading, while others have 
looked at how readers regulate and monitor ongoing processes during reading. 
These two lines of research reflect a difference in emphasis, not two 
independent entities (Brown, Note 4). Accordingly, some researchers have 
attempted to study both aspects of metacognitlon. 

The study by Canney and Wlnograd (1979) is an example of the first kind 
of research. The main purpose of that study was to see if a reader's 
perception of the purpose of reading (decoding vs. meaning getting) was 
related to reading ability. Interview results indicated that many poor 
readers may share the same perspective on reading as the fourth-grader who 
said that good reading is being able to say all the words fast. While these 
results are tentative, they do indicate that there may be aa Important 
relationship between a child's view of reading and his ability to perform. 
Other studies in this vein have looked at such things as children's ability to 
explicitly identify important*-aspects of text (e.g.. Brown & Smiley, 1977; 
Otto, Barrett, & Koenke, 1969; Stein & Glenn, 1978), or the child's view of 
what constitutes a word (Downing & Oliver, 1973-74). 

The focus of this paper, however, is on the research that deals with how 
readers regulate and moiiltor ongoing processes during reading. The question 
under consideration concerns the conditions under which readers monitor how 
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well or how poorly their comprehension is proceeding* This kind of 
comprehension monitoring is important because it provides vital feedback to 
the reader about the effectiveness of hi& reading behaviore A reader who is 
monitoring his own comprehension has a better basis for. selecting the reading 
strategy best suited to the needs of the moment* Indeed^ it might be argued 
that the definition of a fluent reader must include a reference to the ability 
to self-check and self-correct reading strategies* 

In order to understand the factors involved in comprehension monitoring, 
some researchers have used error detection tasks* Such tasks usually involve 
reading (or listening to) a passage in which an error has been embedded* If 
the subject does not mention the error following the reading, probe questions 
are often asked in an attempt to learn why* Error tjrpes have Included 
disorganized passages (Danner, 1976), incomplete Instructions (Markman, 1977), 
inappropriate transition words linking sentences and unclear pronominal 
references (Baker, 1979), and contradictory Informatior (Baker, 1979; Markman, 
1979). Subjects have Included both children and adults* Although the types 
of errors have been different for adults and children j neither age group has 
performed well in any of their respective error detection tasks* This is an 
Important point, and we will return to it later* 

There are many possible explanations of the factors Involved in 
comprehension monitoring* Not surprisingly, these explanations often reflect 
the theoretical biases of the researchers offering them. The remainder of 
this section describes a schema-theoretic perspective of comprehension 
monitoring, and the next section describes an experimental study aimed at 
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addressing the issues of schema activation and comprehension monitoring. The 
final section of the paper will examine, retrospectively, some of the problems 
in the error detection paradigm and- our reasons for selecting additional 
methodologies for future studies. 

The Role of Schemata in Comprehension Monitorin g 

It is important for theoretical, as well as practical, reasons that we 
understand the cognitive mechanisms that are involved in comprehension 
monitoring. A basic assumption in current information processing theory is 
that a human's processing capacity is limited and that cognitive processes 
must compete for space (Norman & Bobrow. 1975). Iherefore we develop ways 
vhich allow us to use our limited processing capacity more efficiently. One 
way is routinization. Cognitive processes that are routinlzed are able to be 
processed with a minimum of effort, freeing valuable processing capacity. 

Since reading comprehension is a cognitive process, it too is involved in 
the race for space. In some situations comprehension is routinized. 
"Comprehension in the normal case is a fully automatic process, that is. it 
makes low demands on resources" (Kintsch & van Dijk. 1978, p. 372). But 
reading comprehension should be considered as a continuum with routinization 
at one end. At the other end, comprehension can be a slow laborious process 
which takes our undivided attention. Comprehension monitoring allows us to 
determine whether our position on the continuum is an effective one. One way 
In which this Is accomplished is by means of a subjective feeling that is 
experienced as "confusion, uncertainty or some similar sensation which informs 
us that we have failed to understand" (Markman. 1979, p. 1). 
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In order to understand how comprehension monitoring vorks^ it Is helpful 
to understand what happens when comprehension Is proceeding smoothly. 
Rumelhart (1977) has developed a definition of comprehension that Is most 
useful here* Comprehension is the "process of selecting and verifying 
conceptual schemata to account for the situation (or text) to be understood" 

268) • A simplified explanation Is that schemata provide a general outline 
and the reader fills in the specific details from the text* 

Schema theory provides a framework for examining how a reader becomes 
aware of a comprehension failure* Consider the possibility that error 
detection results when there is enough of a mismatch between Input and the 
selected schemata to Induce the subjective feelings of confusion. In other 
words ^ properly selected schemata provide the reader with certain 
expectations* When the Incoming Information fails to conform to these 
expectations, the monitoring processes signal trouble* 

Recall the point raised tiarlier, that one of the consistent findings of 
the comprehension monitoring studies is that many readers fail to mention the 
errors embedded in the text* One possible explanation Is that some readers 
mav not have selected the appropriate schemata* Poor readers, in particular, 
tna/ suffer from this problem* There is a considerable body of evidence that 
poor readers often use highly inappropriate schemata. In addition to the 
Canney and Winograd (1979) study mentioned earlier, the interested reader 
should consult Downing (1969), Glass (1968), Johns (1974), Johns and Ellis 
(1976), or Welntraub and Denny (1965). 
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The following study was designed to explore the possibllty that good 
readers are more likely to select appropriate schemata, which help in 
comprehension monitoring, than are poor readers. One way to test this 
possibllty is to see whether poor readers' error detection abilities improve 
when they are given assistance in selecting appropriate schemata. 

Method 

Subjects 

Twenty sixth grade students were divided Into skilled and less skilled 
readers on the basis of Aeir scores on the Stanford Diagnostic Reading Test, 
Form A. Skilled readers were defined as those who scored above the 50th 
percentile nationally. Their scores had a mean of 80, SD of 16, and ranged 
from 532 to 96%- (n - 9). Less skilled readers were defined as those who 
scored below the 50th percentile nationally. Tlielr scores had a mean of 31. 1, 
ID of 11.13, and ranged from 16% to 46% (n « 11). 

As an assurance that all the subjects could decode the words in the 
passages, each subject read a word list which contained, in random order, all 
the words involved in the experimental paragraphs. Each Word appeared only 
once in the list. Accuracy in this decoding task was sufficiently high to 
utilize the data of all subjects in the analyses. 

Materials 

The materials consisted of four ten-sentence paragraphs, two dealing with 
a circus theme and two Healing with a' church theme (see Appendix). All were 
similar to Bransford and Johnson's (1973) Peace March/ Space Travel paragraph 
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in that they were intentionally ambiguous* A single reference to either 
circus or church occurred in the sixth sentence* 

The error type used in this experiment was a contextually anomalous 
sentence* This anomalous sentence occurred as sentence number 8 in each 
paragraph* 

Design 

There were two major factors under consideration* The first factor 
(between-subjects) was reading ability. The second factor (within-subjects) 
was the degree of contextual preparation supplied prior to the reading of the 
paragraphs. There were two levels of the second factor; 

1. No Preparation 

2. Preparation 

The preparation was a production task in which the {.abject looked at a 
picture of two children approaching either a church or a circus (see Appendix) 
and was then asked to "Use your imagination and tell me everything you think 
these two children might see In this circus/church." 

During the no-preparation session the children were asked to read the 
previously described word list. 

Procedure 

The children were tested individually in each of the two sessions, given 
a week apart. The sessions were tape recorded so the children did not have co 
write at any time. They were asked to act as consultants in determining the 
comprehenslbillty of some passages written by other sixth graders. They then 

in 
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received either the preparation or the no^preparatlon task. Next, they were 
told to silently read the first of the paragraphs through twice. When they 
had finished reading, they were asked a series of probe questions to see If 
they had detected the target anomaly. The children then rfead the second 
paragraph (same theme) which was again followed by the probes. 

During the second session, the children were again asked to act as 
consultants, and the procedure was repeated with the two remaining paragraphs. 
The order of the preparation/no-preparation task and the theme of the 
paragraphs were counter-balanced across both sessions." while the paragraphs 
themselves were counter-balanced within each session 

The children's reactions to the paragraphs were monitored closely. If a 
child made, any comment indicating he had detected the target anomaly during 
the initial reading of the passage, he was assigned a score of 1. Otherwise, 
a child's score represented the number of the probe that did produce a 
relevant comment. As soon as a child detected the error, the probes were 
discontinued. However, all the children were asked probe #11. "Tell me what 
the story was about." if a child failed to comment on the target anomaly 
throughout the probes, he was assigned a score of 12. 
The probes were: 

2. Any comments? 

3. Do you have any questions? 

4. What did you think about the story? 

5. Did everything make sense? 

6. Could tlfth graders understand everything? 

7. Could you answer questions about it? 
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8. Would you change anything In the story? 

9. Does everything sound all right? 

10. Are there any sentences that don't fit? 
11» Tell me what the story was about. 

In summary, then, several possible factors underlying comprehension 
monitoring were considered. Two of these factors were of major interest: 
(a) reading ability; (b) assistance in selecting the appropriate schemata 
(preparation) or no assistance (no-preparation). In addition to these major 
factors, story, story order, and session order were examined for their 
possible effects. The dependent measure was the child's score. This variable 
could range from 1 to 12 depending on whether the child mentlctied the embedded 
error during the inltal reading of the passage (1), or in response to one of 
the probes (2-11), or failed to mention the error at all (12). 

Results 

The initial data analysis wa8a2x2x2x2 repeated measures analysis 
of variance. The between-subjects factors were reading ability (high vs. 
low), treatment order (preparation first or no-preparation first), and story 
order within each session. Preparation vs. no-preparation (the experimental 
treatment) was measured within subjects. Table 1 summarizes the two ability 
and the two treatment conditions. 

Insert Table 1 about here 

The analysis indicated that good readers performed slgnilicantly better than 
did the poor readers, F(l,16) - A. 89, £ < .05, but tha^, contrary to 
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prediction, schema preparation prior to reading had no elgnlflcant effect on 
error detection. The only other significant effect In the Initial analysis 
was the Interaction between treatment and the order In which the subjects 
received the treatment (preparation first or no-picparatlon first), F(l,16) - 
7.42, 2. < 'OS. Figure 1 summarlaes this Interaction. 



Insert Figure 1 about here 



One explanation for this Interaction li. that the preparation first group was 
comprised of better readers than the no-preparatlon first group and thus did 
conslatently better over the two sessions. However, a ^-test which compared 
the reading comprehension scores of the two groups Indicated that the two 
groups did not significantly differ from one another, t(ie) - 1.19, ^ > ,05. 

An additional analysis was performed to clarify the order-of- 
presentatlon effects. Since there was no main effect for treatment, a 
2x2x2 repeated measures analysis of variance was run on the factors of 
reading ability, session (first or second), and story order within session. 
Figure 2 clearly shows the significant effect of session, F(l,36) - 6.3, 
£ < .05, as well as the significant effect of reading ability, F(l,36) - 6.05, 
£ < .05. 



Insert Figure 2 about here 



Simply put, good readers did better than poor readers, and both groups did 
better the second time around. 
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One potential problem in the initial analysis was the excessive error 
variance associated with using the twelve probes as the dependent measure. 
Many subjects received the highest score (1) on the first paragraph and then 
the lowest score (12) on the next paragraph, or vice versa, within the same 
session* For this reason, we thought that a new scaling system was needed 
which would reduce the variance and perhaps reveal other patterns in .the data. 
A new scaling system was devised which awarded a 1 If the subject 
spontaneously mentioned the target anomaly; a 2 if any of the probes resulted 
In an error detection response; and a 3 if the subject failed to mention the 
target error at all. The original 2x2x2x2 repeated measures analysis of 
variance was rerun using this scaling system. Reading ability approached 
significance, F(l, 16) - 3.9A, ^ < .06, and the significant treatment-by-order 
Interaction increased to F(l,16) - 8.71, £ < .01. The new results differed 
little from the results of the first analysis, indicating that the variance 
had not obscured other pdssible effects. 

In order to examine the materials used in the experiment, the effects of ^ 
the treatment were considered for each story. The cell means are shown in 
Table 2. 

Insert Table 2 about here 

An analysis of variance (Winer, 1962, pp. 635-639) Indicated that, while there 
was still no main effect for treatment, there was a significant main effect 
for stories, F(3, 49) - 3.98, £ < .05. Post-hoc analysis (Scheffe) indicated 
that story 3 was significantly different from stories 1, 2, and A, £ < .05, 

• * 
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and that stories 1, 2, and 4 did not dlffei- significantly from one another. 
Tables 3, 4, 5, and 6 represent the ability by treatment conditions for each 
story separately. Performance on stories 1 and 4 was as predicted, whereas on 
story 3 results were In the opposite direction. Story 2 was Inconclusive. 

Insert Tables 3, 4, 5, and 6 about here 

The efficiency of the probes used as the measurement Instrument was 
examined via the distribution of frequencies of triggering a correot error 
detection response. Table 7 shows this Information. 

Insert Table 7 about here 

It appears that probes 6, 7, and 9 failed to elicit any error detection 
responses at all, and that probes 3 and 8 functioned minimally. Probes 2, 5, 
and 10 seemed to function best. Seventy-three percent of the total responses 
were made either during the Initial reading of the passage (41%) or during the 
first four probe questions (31X). Thus, the early probes seemed to be more 
effective than did the later ones. It Is Interesting to note that probe #10, 
"Are there any sentences that don't fit?" accounted for 23% (5/22) of the 
possible remaining responses^ 

Discussion 

This discussion Is divided Into three parts. First, the results of the 
schema activation experiment will be discussed. Second, we will focus on the 
difficulties and limitations In the use of the error detection paradigm 
Itself. The third part will be concerned with some of the alternative 
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paradlgma which are currently In use, and with some suggestions for improving 
the methodologies used In future comprehension monitoring research* 

A surprising number of the sixth graders were quite poor at overtly 
detecting some very blatant errors. Only 56% of the good readers and 18% of 
the poor readers mentioned all four errors. If story 3 is excluded from this 
analysis, 88% of the good readers and 45% of the poor readers mentioned all 
three of the target anomalleg* Good readers, as expected, did significantly, 
better than did poor readers, but neither group did outstandingly well on the 
error detection task* While these results support those of earlier studies 
(Baker, 1979; Markman, 1977> 1979), they leave unanswered a central question: 
Did the children fall to detect the errors ot did they just fail to mention 
them? Vte atterapteci to increase communication by having a period of discussion 
with each child to establish rapport, and by telling the children that the 
stories were written by othe?^ sixth graders* There was evidence in the 
protocols that most of the children criticized some aspect of the stories* 
However, the criticism of unintelllglbilty is a m^ijor one and may be perceived 
as belftg a reflection on the reader's ability* Thus the question of whether 
or not the children detected the error is still unanswered* The difficulty of 
answering thls^ question is one of the major problems of the error detection 
paradigm and will be discussed in depth later* 

The only other statistically significant finding in the initial analysis 
was the Interaction between treatment and the order in which the children 
received the treatment. As reported earlier, one possible Interpretation was 
that the group of children who received the preparation treatment during the 
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first session were simply better readers overall than the children who 
received the no-preparation treatment first. However, the non-significant 
results of the Jt-test, which compared the comprehension test scores of the two 
groups, argues against this interpretation. The Interpretation we favor is 
that those children who received the preparation in the first session 
benefited from it and that this advantage, combined with the general 
order-of-session, effect, carried over into the second session. Although the 
treatment effects were not significant, this plausible interpretation of the 
data does offer support for our original hypothesis. 

An additional analysis was performed on the factors of reading ability, 
order of presentation, and story order within each session. The results from 
this analysis clearly showed the effects of session order. "The children did 
better in the second session. Whether this improved performance resulted from 
a better understanding of the task or an increased rapport with the 
experimenter is hard to determine. Either explanation supports the need for 
having a longer warm-up session as well as insuring that the children fully 
understand the task. 

Overall, it appears that the treatment had no significant effect. A more 
fine-grained analysis shows why. Data from two of the stories (1 and 4) 
provided the expected results. Data from story 2 was inconclusive. Those 
from story 3 produced some very strong results In the opposite direction. 
While our hypotheses predicted that all readers would be more likely to spot , 
the errors in the preparation condition and that this would be more so for the 
poor readers, the results from story 3 indicated quite the reverse. Both 
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groups did worse in the preparation condition and this was especially ttue for 
poor readers (See Table 5). Apparently, some children assumed that the 
teacher was at Sunday School, thus rendering the Intended anomaly quite 
meanirigful. Story 3 emphasizes the need for ensuring that all of the embedded 
errors are as similar as possible, both qualitatively and quantitatively • 
This problem will also be discussed further In. the next section^ 

It is interesting to note that the preparation condition enhanced this 
Sunday School inference for Story 3 for both good and poor readers^ However, 
the effect was stronger for poor readers* Ihese data can be inteirpreted as 
tending to confirm the original hypothesis in that the greater the schema 
preparation, the more easily readers were able to find a "slot" for. such 
ambiguous information* These data also raise another Interesting question: 
Do poor readers^ inferenclng abilities improve when they are given assistance 

« 

In selecting the appropriate schema? . " 

Another finding of importance concerned the "probes* Seyeral of the 
probes faf led to elicit any error detection responses* Unfortunately, these 
same probes are some of the most intuitively appealing* It is unclear whether 
the problem lies in the probes themselves or in the order in which they were 

Iven, although the evidence (see Table 7) does suggest that earlier probes 
are more effective* The probes also caused other problems* Some of the 
children became Impatient with the experimenters when they were asked what was 
basically the same question several times* It is also very difficult to 
accurately assess what training effect the probj?s produced* It is possible 
that some of the children's purposes for reading were altered as the probes 
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became more specific* It is also possible that the probes had an Influence on 
the children's perception of the experimental task demands* Evidence for this 
last point can be found in the fact that probe #10» ^'Are there any sentences 
that don't fit?" elicited a large number of error detection responses from 
children who» up to that point in the interview^ had not mentioned the error* 
This study failed to find any significant effect of schema activation on 
children's error detection abilities* However » we feel that the error 
detection paradigm did not allow for a strong test of the hypothesis* It will 
prove Instructive to look at some of the difficulties and Ilmltatlona of the 
error detection paradigm which formed the basis for this concluslpn* Several 
of these problems have already been mentioned* These, along with some others, 
will now be considered in detail* 

The most serious limitation of the error detection paradigm is the 
difficulty of determining why subjects do so poorly on the task* One cannot 
say for certain that the subjects' comprehension monitoring > abilities are poor 
because they failed to mention the error* There are numerous other 
explanations* Some of these have beea mentioned in the literature (.Baker, * 
1979; Markman, 1979)* For example: 

1« A reader^ s lack of relevant background knowledge may cause him to 

overlook the error* ^ 
2* Readers, especially young ones, may suspend disbelief because they 

have read much that is unbelievable* 
3* Older readers may have an overriding faith in the Cooperative 
Principle (Grice, 1975), which states that speakers and writers 
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usually Intend their messages to be truthful, relevant, and 
unambiguous. 

4. Readers may not believe that texts can and often do contain errors. 

5. Readers may make Inferences that seem to resolve the errors and 
discrepancies. 

6. Subjects (young children) may not recall the Inconsistent 
information (Markman, 1979). 

7. Subjects may lack the logical capacity to to make the necessary 
inferences (Markman, 1979). 

8. Subjects may be hesitant to criticize the experimenter in a testing 
situation (Markman, 1979). 

9. Subjects may draw upon prior knowledge to supplement explicitly 
presented information (Baker, 1979). 

10. Subjects may assign alternative meanings to the text (Baker, 1979). 

11. Subjects may assume that the writer has made a mistake and Ignore It 
(Baker, 1979). 

12. Subjects may notice the error but. assume that subsequent Information 
would resolve the problem (Baker, 1979). 

Thus to assume that raetacognltlve abilities are not well developed because 
subjects do poorly on the error detection tasks is unwarranted. 

Another problem, closely related to the first. Involves setting a 
criterion for deciding when comprehension Is adequate. The difficulty arises 
when the experimenter assumes, either implicitly or explicitly, that the 
subject's purpose for reading matches his own. Baker (1979), for example. 
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reports that some of her subjects did not respond to the target error because 
they were Reading for the main ideas. They felt that they had understood the 
central theme even if one of the sentences seemed to be in conflict. 

It is likely that comprehension monitoring is intimately tied to the 
reader's purpose for reading. Unless some effort is made to accurately assess 
or control for the subject's purpose for reading, it is difficult to make any 
generalizations about a reader's abilitj^ to detect errors. 

The third ptoblem with error detection studies involves specifying the 
kind and degree of target error • Consider aome of the different categories of 
errors that can be used; 
1« Omissions 
2» Inconsistencies 
3» Unclear pronominal references 

Inappropriate transition words ^ ^ 
5» Disorganized passages 
6« Anomalous sentences 

Spelling errors 
8» Grammatical errors 
It should also be noted that there Is a wide choice of error type within each 
of these categories. 

It may be that there Is an error type by subject by task demand 
interaction which again limits the usefulness of any gi'.nerallzatlon^ Danks 
and his colleagues (Danks, Fears, Bohn, & Hill, Note 5) offer evidence that 
some kinds of errors may affect comprehension processes which are text driven 
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while other kinds of errors may affect those comprehension processes which are 
schema driven. If, as Splro and Tirre (1979) have suggested, readers differ 
in their use of next-based or knowledge-based Information, then the possible 
interaction between Individual differences and error types needs to be 
considered • 

Just as the kind of error Is Important, so too is the location of the 
error* Baker (1979) reported that errors placed high In the text structure 
were noticed more often than the same errors placed lower In the hierarchy. 

The fourth limitation with the error detection paradigm lies in the use 
of probes to see if the subjects noticed the errors. Two of these problems 
were mentioned earlier. First, some of the children became impatient when 
they were repeatedly asked for their opinions about the stories. Ten probes 
may be Just too many to ask. The second problem with the probes, lies in 
accurately assessing what effect they are having on the children's 
performance. Probes which ask for specific information may Induce a different 
comprehension set than do probes which are more general in nature. A third 
problem arises when the probes are used as the basis for the scoring 
procedure. In this study, for example, the scoring procedure assumes equal 
Intervals between probes. Although this proceduxre has been used before 
(Markman, 1977, 1979), it is difficult to Justify on statistical grounds. 

The fifth weakness in the error detection paradigm is that it relies on 
subjects to make verbal reports about their cognitive processes. Nisbett and 
Wilson (1977) argue persuasively that there may be little or no direct 
l-'trospection of higher order cognitive processes. Instead, subjects base 
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their reports on their Judgments of what they consider to be plausible causes 
rather than on true introspection. This problem Is compounded in the error 
detection paradigm because the probes may "lead" a subject to certain 
conclusions. Brown (1978) has also illustrated the difficulties in accepting 
verbal reports from young children. What children (and adults) say is often 
different from what they actually do. 

These, then, are Lhe major difficulties in using the error detection 
paradigm: 

1. Determining why subjects do not overtly respond to the presence of 
errors in the text. 

2. Determining which criteria for comprehension subjects have chosen to 
apply. 

3. Adequately specifying the kind, magnitude, and placement of the 
target errors. 

4. Overrelying on the use of probes as the dependent measure. 

5. Overrelying on subjects' (especially children) verbal reports about 
their own cognitive processes. 

The existence of these problems dc^s not mean that the error detection 
paradigm io useless and should be avoided. However, It does mean that a great 
deal of thought should be given to which research questions can be addresse. 
by such a methodology. This paradigm is at its weakest when it is used to 
answer such general questions as: "Do embedded errors affect the reader?" or 
"How is the reader affected?" It is at its best when it is used to assess a 
reader's ability to overtly report the effects of embedded errors. It Is 
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Important to note that the error detection paradigm is only one possible 
measure of metacognltion and that Its contribution, though limited, may still 
be of value* Next we will consider some of the alternative methodologies 
currently In use and offer some suggestions for Improving future comprehension 
monitoring research • 

What can be done to further our understanding of comprehension 
monitoring? One answer (Brown, 1978; Kuhn, 1974) Is to use a variety of 
t^sks* An example Is a paradigm that has been used by Brown and her 
associates (Brown & Smiley, 1977; Brown, Smiley, & Lawton, 1978) • The 
subjects are asked to read or listen to a passage after which a recall measure 
Is taken • They, then rre told to study in preparation for another recall test* 
Sometimes they are told to pick the retrieval cues they think will be most 
helpful • The data consists. pf two sets of recall and any notes or cues the 
subjects utilize ♦ These data can be analyzed In such a manner as to provide 
the link between process and performance measures which are so important In 
Interpreting strategy use and effectiveness (Ryan, in press)* 

Another related suggestion for improving comprehension monitoring 
research is for the experimenter to set the criterion for adequate 
comprehension* Both Markman (1977) and Baker (1979). noted that error 
detection Improved when subjects were given explicit directions to find the 
problem* Therefore, It Is Important that we study comprehension monitoring 
under a variety of reading purposes before making any general statements about 
children's metacognltlve abilities* The relationship between the reader's 
purpose and comprehension monitoring Is too Important to be left to chance* 
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There are several alternative comprehension monitoring psradigms that do 
not rely on the use of probes or other introspective verbal reports. This Is 
important because performance measures, rather than introspective verbal 
reports, seem to be especially promising. Clay (1973), for example, has 
studied the self-correction of spontaneous errors by young children during 
oral reading. She found that the self-correction rate was more closely 
related to reading achievement scores in the first three years of instruction 
than either reading readiness scores or intelligence. 

Danks et al. (Note 5) also used oral reading as the on-line measure. The 
hypothesis in that study was that different kinds of embedded errors would 
affect different components of the comprehension process. They found, for 
example, that embedded errors which violated syntactic and semantic 
constraints disrupted oral reading sooner than did semantic errors or logical 
inconsistencies. Results such as these may offer insights Into the role of 
metacognition in an interactive model of reading. These results also Indicate 
the importance of adequately specifying the kinds of errors used. 

The two preceeding paradigms have both used oral reading as the on-line 
measure. Although 'oral and silent reading may be similar in many respects, it 
Is unsafe to assume they are Identical (Danks & Fears, in press). One method, 
yet to be tried, la the use of eye movement technology in studying the effects 
of different kinds of embedded errors. Studies (McConkie. Note 6) are being 
planned which will extend the work of Danks and his colleagues. The goal is 
to develop a time line representing the different latencies of the different 
kinds of embedded errors In an attempt to get aeparace measures of bottom-up 
and top-down processes In comprehension. 
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Another methodological approach Is exemplified by the work of DlVesta, 
Hayward, and Orlando (1979). Their work Is based on the assumutlon that 
effective strategy use reflects metacognltlve skill. They devised a cloze 
test which measured differences In the reader's use of running and subsequent 
text. Their results Indicated that there are developmental and ability 
differences In the strategies used In searching for needed Information. 
Although these results are not surprising, the methodological appproach Is 
promlslngt 

Each methodology has Its own contribution to make and Its own .1 Imitations 
to overcome. Thus, If a variety of experimental tasks and measures are used, 
more confidence can be placed in the data and any generalizations drawn from 
them. One such generalization that can be safely drawn now is that most 
readers are capable of exhibiting a wide variety of metacognltlve abilities. 
However, many of these behaviors are extremely subtle, and the major 
difficulty lies in accurately measuring them. Since it is clear that most 
readers can monitor their comprehension, the major questions now involve 
specifying how and under what conditions they do so. 
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Story 1 

The view was breathtaking. From our seats we could see the crowd 
below. Everything looked extremely small from such a distance, but the. 
colorful uniforms could still be seen. At first there was a great deal of 
activity. There seened to be lots of children as well as adults and they 
all seemed to be looking for a place with a good view. The circus is 
always such an exciting place to visit. We all stood up and cheered when 
the music started. My mother's best dish fell off the dinner table and 
broke. We took many pictures of th6 setting and the crowd. Everyone was 
very friendly and we were glad that We had the chance to come. 
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Story 2 

It was the best thing we ever saw* There were hundreds of people. ^ 
everywhere. Some were riding and some were walking. Things w^re going on 
all over the place. Some people were looking for places to buy food and 
drinks* There are so many things to do at the circus. After we bought our 
food we tried to find some good seats. It seemed like the big ship would 
sink in the rough sea . It was so noisy where we were that we could barely 
near the music. I could see some animals over on the side* We took lots 
of pictures of everything. 
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Story 3 

When we arrived there were still plenty of seats. We had gotten 
there just in time because soon every seat was filled. I saw many people 
that I knew and I waved at some of them. All of a sudden things started 
to happen. The people in front of me stood up and I couldn't see a thing. 
All I could do was stand up and look at the church windows. Everybody 
finally sat down when the music was over. The teacher said it was time for 
us to put the toys away. My parents had been coming here for years but this 
was my first visit. I enjoyed it enough to come back again and again. 
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Story 4 

It was very quiet when I sat down. The man in front began to talk. 
From where I sat 1 could barely hear him. I looked around at all the 
people. They were all dressed up in their best clothes but nobody was 
smiling. This was the first time I had ever been to ray uncle's church. 
This was very different from anything I had ever seen before. When the 
batter ,hit a homerun, we all cheered . Everybody looked restless and some 
people began to yawn. Whep the man up front had finished speaking, the 
people got up to leave. Where I was sitting was very uncomfortable so I 
was glad it was over at last. 
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Table 1 

Mean Performante Scores of High and Low Ability Students 
With and Without Preparation 

Preparation No Preparation Row Means 
Kigh Ability 3.03 3.17 3.1 
Low Ability 5.79 5*62 5,71 
Column Means 4.41 4.4 
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Table 2 
Mean Performance Scores 
across Stories and Treatment Conditions 



• • eparation 


Story 1 


Story 2 


Story 3 


Story 4 


1.55 


4.55 


9.67 


3.11 


(1.21) 


(4.89) 


(4.18) 


(2.93) 


No Preparation 


5. 44 


4.44 


4.54 


4.1 


(4.95) 


(4.72) 


(4.59) 


(4.18) 



Note ; Standard deviations are shown in 
parentheses. 
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Table 3 

Mean Performance Scores of High and Low Ability Students 

for Story 1 

Preparation No Preparation Row Means 

High Ability 1.2 3 2*1 

Low Ability 1.8 7.8 4.6 

Column Means 1.5 5.2 — 



Comprehension Monitoring 
i 41 



Table 4 

Mean Performance Scores of High and Low Ability Students 

for Story 2 

Preparation No Prepai:ation Row Means 
High Ability 1.8 4 2.9 

Low Ability 6.3 4.8 5.8 

Column Means 4*3 4,4 
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Table 5 

Mean Performance Scores of High and Low Ability Students 

for Story 3 

Preparation No Preparation Row Means 
High Ability 7.3 4 5.7 

Low Ability 11.6 4.8 8.2. 

Column Means 9.5 4.4 
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Table 6 

Mean Performance Scores of High and Low Ability Students 

for Story 4 

Preparation No Preparation Row Means 
High Ability 2.3 2.6 2.5 

Low Ability 3.8 5.3 4.6 

Column Means 3.1 3.95 
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Table 7 

Analysis of the Efficiency of the Interview Probes 
Score Frequency Probe // Probe 



1 33 Target hit. during reading 

2 15 2 Any conuu^snts? 

3 2 ' 3 Do you have any questions? 

4 3 4 What did you think about the 

story? 

3 5 5 Did everything make sense? 

6 0 b . Could fifth graders understand 

everything? 

7 0 7 Could you answer questions 

about it? 

8 1 8 Would you change anything in 

the story? 

9 0 9 Does everything sound all 

right? 

10 5 10 Are there any sentences that 

don't fit? 

11 0 11 Tell me what the story was 

about. 

1^ lb No hit at all 

V ^ 

- ?^ 
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Figure Captions 



Figure 1, Treatment effects within and across groups by tcJsting 
sessions* 

Figure 2. Reading ability by testing session. 
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